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Descripti n 

[0001 ] This invention relates to methods of and appa- 
ratus for processing two or more sequences of data 
packets receiv d from an twork, each of said s quenc- 
s of data packets r pr senting a common program 
source. 

[0002] Internet applications that employ audio and 
video streaming are becoming increasingly prevalent. 
(When used herein, the term "audio" will be intended to 
include speech as one example of an audio signal.) As 
a natural consequence of transmitting and receiving da- 
ta over a data packet-based network such as the Inter- 
net, when network traffic is large the network gives rise 
to relatively large packet delays. In particular, packet de- 
lays usually vary considerably depending on the mo- 
mentary level of network congestion. Moreover, data 
packets are sometimes even lost completely by the net- 
work. Since applications which employ audio and video 
streaming are typically used in non-interactive environ- 
ments, however, the end-to-end delay is usually not crit- 
ical. 

[0003] For these reasons, and as is totally familiar to 
those of ordinary skill in the art, data packets from such 
streaming applications are usually buffered at the re- 
ceiving end over a time period which may typically be 
several seconds in duration. This buffering helps to re- 
duce the detrimental effects of the relatively large and 
variable packet delays which result from the varying lev- 
els of network congestion. Packet losses in the network 
are typically addressed by using a forward error correc- 
tion code across the packets, as is also fully familiar to 
those skilled in the art The error correction capability of 
such an error correcting code typically improves with the 
size of the data packets. 

[0004] Clearly then, a large receive bufferis highly de- 
sirable to provide a better quality signal, because it in- 
creases the probability that most of the transmitted 
packets representing data within the given (i.e., the buff- 
ered) period of time will have been successfully accu- 
mulated in the buffer before it is necessary to decode 
them for Aplayback.= However, since the receive buffer 
usually needs to be initially filled before the signal can 
be decoded, a large buffer necessarily gives rise to a 
correspondingly large buffering delay, and, in particular, 
a large start-up delay. Start-up delays of a few seconds 
can be quite annoying, especially when a channel 
switch is made in an Internet broadcast environment. 
Such an environment typically involves an Internet 
backbone which broadcasts many independent pro- 
grams, and a number of users which receive their indi- 
vidually selected program via a server connected to the 
backbone. A large start-up delay could thus be quite 
bothersome when a user changes the selected broad- 
cast program. It would be highly desirable, therefore, to 
provide a source coding and r c iv data buffering 
scheme which results in more acc ptable start-up de- 
lays without sacrificing the b nefits of using a large re- 



2 

ceiv buffer. In this manner, relatively painless channel 
switches may be effectuated whil still maintaining high 
quality steady-state p rformance. 
[0005] According to one aspect of this inv ntion there 
5 is provided a m thod as claimed in claim 1 . 

[0006] According to anoth r aspect of this invention 
there is provided apparatus as claimed in claim 8. 
[0007] A novel technique is disclosed whereby the 
start-up delay that may occur when initiating or switch- 
ing received programs in audio (including speech) or 
video streaming applications is advantageously re- 
duced while maintaining high quality steady-state per- 
formance thereof. 

[0008] In accordance with an illustrative embodiment 
of the present invention, a program source {e.g., an au- 
dio and/or video data stream) is encoded and transmit- 
ted as two or more separate bit streams (e.g. , sequenc- 
es of data packets), wherein the transmission of one of 
these bit streams has been delayed prior to transmis- 
sion by a given amount of time relative to the transmis- 
sion of the other bit stream(s). At the receiving end, 
these two or more bit streams are buffered by receive 
buffers having different buffering delays (e.g., as a result 
of having different buffer sizes), wherein the time delay 
difference corresponds (inversely) to the relative delay 
times effectuated between the bit streams prior to trans- 
mission. 

[0009] In accordance with one illustrative embodi- 
ment of the present invention, it may be advantageous 
to employ a multiple descriptive source coding scheme, 
familiar to those skilled in the art. As is well known, in 
such a scheme, each of two or more individual bit 
streams are coded, each bit stream being sufficient by 
itself so that when it is decoded, a reproduction of the 
original program source having a satisfactory signal 
quality is obtained. However, when a combination of two 
or more of these individual bit streams is decoded, a re- 
produced signal of improved quality will result. (See, e. 
g. t Michael T. Orchard et a/., ARedundancy Rate-Dis- 
tortion Analysis of Multiple Description Coding Using 
Pairwise Correlating Transforms,= Proc. IEEE Interna- 
tional Conference on Image Processing, Oct., 1997.) In 
this case, it is useful to transmit one of the individual bit 
streams as the Aseconds sequence of data packets, 
and either another one of the individual bit streams, or 
preferably, a combination of two or more of the individual 
bit streams as the Afirst= sequence of data packets. 
(Note that it will be obvious to those skilled in the art that 
for the efficient use of channel bandwidth, in any em- 
bodiment of the present invention for which it is desira- 
ble that the same data be included in multiple bit 
streams, that data can be advantageously transmitted 
as a part of only one of these bit streams, and then re- 
combined with the other(s) at the receive end of the 
channel , either before or after the corresponding decod- 
ing of the encoded bit stream data is performed.) 
[0010] In accordance with another illustrative embod- 
iment of the invention, it may be advantageous to em- 
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ploy an embedded coder, also familiar to thos skilled 
in the art, in which a core layer and on or more en- 
hancement lay rs are s parately coded. (See, e.g., Ju- 
rgen Herr et a/., ATh Integrat d Flit rbank Based 
Scalable MPEG-4 Audio Coder,= 1 05th Audio Engineer- 
ing Soci tyConv ntion, San Francisco, S pt., 1998.) In 
this case, it is useful to transmit the core layer bit stream 
as the Asecond= sequence of data packets, and a com- 
bination of the core layer bit stream and the enhance- 
ment layer(s) bit stream(s) as the Afirsts sequence of 
data packets. Again, the channel bandwidth efficiency 
Atechnique= described above can be advantageously 
employed. And also, in accordance with still another il- 
lustrative embodiment of the invention, the data streams 
may advantageously comprise multiple encodings of 
the program source each having a different bit rate, 
wherein lower bit rate encodings are transmitted with 
correspondingly larger delays (and thus buffered at the 
receiver with receive buffers having correspondingly 
shorter buffer delays). 

Brief Description of the Drawings 

[0011] 

Fig. 1 shows a first illustrative environment for an 
audio or video streaming application in which the 
start-up delay for a given program broadcast may 
be advantageously reduced in accordance with an 
illustrative embodiment of the present invention. 
Fig. 2 shows a second illustrative environment for 
an audio or video streaming application in which the 
start-up delay for a given program broadcast may 
be advantageously reduced in accordance with an- 
other illustrative embodiment of the present inven- 
tion. 

Detailed Description 

[0012] Fig. 1 shows a first illustrative environment for 
an audio or video streaming application in which the 
start-up delay for a given program broadcast may be ad- 
vantageously reduced in accordance with an illustrative 
embodiment of the present invention. In particular, the 
figure shows a program source, A(n), which is encoded 
by both source coder 1 1 and source coder 1 2 to produce 
two independent bit streams, a n (n) and a 2 (n), respec- 
tively. Each of these source coders may comprise any 
one of a number of conventional packet-based coders 
familiar to those of ordinary skill in the art, and as may 
be used for the coding of, for example, audio and/or vid- 
eo program data for transmission across a packet- 
based network such as, for example, the Internet. 
[0013] Advantageously, the encodings performed by 
these two source coders are such that a reproduction of 
the original program source signal should b obtainable 
by decoding a 2 (n) only, and, pref rably, such decoding 
should produce a signal of a reasonably acceptable 



quality. Moreov r, a decoding of either a 1 (n) individually, 
or, alternatively, a combination of a decoding of each of 
a^n) and a 2 (n), advantageously results in a reproduc- 
tion of the original program source signal having a su- 
5 perior quality to that which is obtainable by decoding a 2 
(n) only. 

[001 4] Specifically, in accordance with certain illustra- 
tive embodiments of the present invention, source cod- 
ers 11 and 12 may advantageously implement one of a 
io number of various coding schemes, each of which is fa- 
miliar to those of ordinary skill in the art, designed to 
provide these advantageous characteristics. For exam- 
ple, it may be desirable to employ a multiple descriptive 
source coding scheme, in which each of two (or more) 

is individual bit streams are coded and are sufficient by 
themselves to obtain a decoded signal having a satis- 
factory quality, but wherein the decoding of a combina- 
tion of the two (or more) of these individual bit streams 
will result in a signal having improved quality as com- 

20 pared thereto. In this case, one of theses individual bit 
streams may be generated by source coder 12 and 
transmitted as signal a 2 (n), while the other one of these 
individual bit streams (or one of the other bit streams if 
there are more than two such individual bit streams) is 

25 generated by source coder 1 1 and transmitted as signal 
a^n). At the receiving end of the transmission channel 
(see the discussion below), a combination of these two 
(or more) individual bit streams (the combination being 
effectuated either before or after the decoding process) 

30 can be used to produce the higher quality signal. 

[0015] In accordance with another illustrative embod- 
iment of the invention, it may be advantageous to em- 
ploy an embedded coder, also familiar to those skilled 
in the art, in which a core layer and one (or more) en- 

35 hancement layers are separately coded. In this case, 
the core layer is coded by source coder 12 and trans- 
mitted as signal a 2 (n), while the enhancement layer (or 
one of the enhancement layers if there is more than one 
such layer) is coded by source coder 1 1 and transmitted 

40 as signal a^n). As above, at the receiving end of the 
transmission channel (see below), a combination of 
these two (or more) individual bit streams (combined ei- 
ther before or after decoding) can be used to produce 
the higher quality signal. 

45 [0016] And also, in accordance with still another illus- 
trative embodiment of the invention, the data streams 
may advantageously comprise multiple encodings of 
the program source each having a different bit rate, in 
this case, source coder 11 produces the encoding hav- 

so ing the larger of the bit rates and transmits the resultant 
data stream as signal a^n), whereas source coder 12 
produces the encoding having the smaller of the bit rates 
and transmits the resultant data stream as signal a 2 (n). 
[0017] In any case, and in accordance with the illus- 

55 trative environment of Fig. 1 , signal a 2 (n), as generated 
by source coder 12, is delayed prior to transmission (rel- 
ative to th transmission of signal a t (n) as generated by 
source coder 1 1 ) by conventional delay element 1 4. The 
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amount of d lay which is applied, n d , is advantag ously 
approximately equal to the differenc in the delays 
which are to be incurred by the rec ive buffers used at 
the receiver prior to the decoding of the two data 
streams, a,(n) and a^n) - se the discussion below. 
Thus, delay element 1 4 produces signal a^n-n^, name- 
ly, signal a 2 (n) delayed by an amount of time n d . Channel 
1 6 represents a communications channel adapted to the 
transmission of packet-based data streams such as, for 
example, the Internet. Alternatively, however, channel 
1 6 may comprise any of a number of other possible com- 
munications channels, including (but not limited to), for 
example, a telecommunications network (such as, for 
example, a Local Exchange Carrier network or an Inter- 
exchange Carrier network), or a local or wide area com- 
puter network. 

[001 8] In accordance with the illustrative embodiment 
of Fig. 1 , the receiving end of channel 1 6 comprises two 
receive buffers - receive buffer 17 and receive buffer 
18. Receive buffer 17 is adapted to receive the data 
stream which was transmitted as a 1 (n), and receive buff- 
er 1 8 is adapted to receive the data stream which was 
transmitted as a 2 (n). Receive buffer 17 has an associ- 
ated buffer delay of n 1 and receive buffer 18 has an as- 
sociated buffer delay of n 2 . For example, these particu- 
lar associated delays may result from the specific buffer 
sizes which are chosen for use in accumulating the re- 
ceived data packets. (A larger buffer size typically cor- 
responds to a larger associated buffer delay. The ad- 
vantages of using larger buffer sizes and larger buffer 
delays are well known to those of ordinary skill in the art 
and are described above.) Specifically, in accordance 
with the principles of the present invention, n 1 > n 2 . In 
particular, n 1 advantageously approximately equals the 
sum of n 2 and n d (i.e., ^ = n 2 + n d ), where n d is the delay 
associated with delay element 14 (on the transmission 
Aside= of communications channel 16) as described 
above. 

[0019] Receive buffer 17 and receive buffer 18 are 
used to provide the input to decoder 21 and decoder 22, 
respectively. These two decoders correspond to source 
coders 1 1 and 1 2, and are used to generate correspond- 
ing reproductions of the original source program from 
the two data streams a^n) and a 2 (n), denoted in the fig- 
ure as b^n) and b 2 (n), respectively. In particular, decod- 
ers 21 and 22 implement conventional decoding of 
packet-based bit streams, and, in particular, use decod- 
ing algorithms which correspond to the encoding algo- 
rithms that were used by source coders 1 1 and 1 2. (That 
is, the decoding algorithm implemented by decoder 21 
comprises a conventional decoding method for decod- 
ing data streams produced by the conventional encod- 
ing algorithm implemented by coder 11 , and the decod- 
ing algorithm implemented by decoder 22 comprises a 
conventional decoding m thod for decoding data 
streams produc d by th conventional ncoding algo- 
rithm implemented by coder 12.) In ord rto provid ac- 
curate and robust decoding of the incoming bit streams, 



decoders 21 and 22 advantageously delay for a time pe- 
riod equal to n 1 and n 2 , r spectiv ly, both after an initial 
receiver start-up (e.g., when pow r is applied) and after 
a receiver Achannek change is effectuated (/.a, the se- 

5 lection of a different broadcast source program), before 
the corr sponding decoding process b gins. (As de- 
scribed above, rij and n 2 are the buffer delays associ- 
ated with buffers 1 7 and 1 8, respectively.) 
[0020] Finally, in accordance with the principles of the 

10 present invention as embodied in the illustrative envi- 
ronment of Fig. 1, selection processor 24 operates to 
produce the resulting reproduction of the original source 
program, B(n). In particular, this may be done by select- 
ing either the output of decoder 21 or the output of de- 

15 coder 22 according to the amount of time which has 
elapsed either since receiver start- up or since a receiver 
channel change has resulted in the selection of a differ- 
ent broadcast source program. Specifically, the output 
of decoder 22 is initially selected by selection processor 

20 24 (after delay n 2 has elapsed, thereby enabling the 
proper decoding of bit stream a 2 (n)), but subsequently 
- in particular once delay n 1 has elapsed (thereby ena- 
bling the proper decoding of bit stream a^n)) - the out- 
put of decoder21 is selected instead. (Recall that in ac- 

25 cordance with the illustrative embodiment of the present 
invention being described herein, n-j > n 2 . Thus, delay 
n 2 will elapse before delay n 1 has elapsed.) In this man- 
ner, a reproduction of the program source, albeit one 
having somewhat less than the best quality available, is 

30 provided after delay n 2 has elapsed, but prior to the time 
when delay n 1 has elapsed, thereby at least partially 
ameliorating the excessive delay that might otherwise 
be encountered upon either receiver start-up or when a 
receiver channel change occurs as a result of the selec- 
ts tion of a different broadcast source program. 

[0021] As discussed above, in accordance with cer- 
tain embodiments of the present invention in which a 
coding scheme is used in which a higher quality signal 
is advantageously obtained based upon a combination 

40 of the two data streams a., (n) and au>(n), decoder21 may 
use the outputs of both receive buffer 1 7 and receive 
buffer 18 to produce its reproduction of the original 
source program after delay n 1 has elapsed. Alternative- 
ly, embodiments employing such coding schemes may 

45 allow for the individual decoding of the two data streams 
a^n) and agfn) by decoder 21 and decoder 22, respec- 
tively, and then combine (e.g., within selection proces- 
sor 24) these decodings in a conventional manner to 
produce the higher quality reproduction. Note that in this 

50 latter case, selection processor 24 advantageously out- 
puts signal b 1 (n) after the delay n 2 has elapsed but be- 
fore the delay n 1 has elapsed (recall that n 1 > n 2 ), and 
then outputs an appropriate combination of signal b 1 (n) 
and signal b 2 (n) (i.e., after the delay n 2 has elapsed) as 

55 its final reproduction of the original source program, B 
(n). 

[0022] Fig. 2 shows a second illustrative environment 
for an audio or video streaming application in which the 
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start-up delay for a given program broadcast may be ad- 
vantageously r due din accordance with another illus- 
trative embodiment of the pres nt invention. In particu- 
lar, the illustrative environment shown In Fig. 2 provides 
for three (ratherthan 2) bit str ams, which may be us d, 
for example, to produce at least thr I v Is of increas- 
ing quality reproduced source program signals, again at 
the Aexpenses of increasing the associated decoding 
delays (and thus, for example, increasing start-up de- 
lays). Note, of course, that it will be obvious to those of 
ordinary skill in the art to extend the principles of the 
invention to embodiments comprising even more (i.e., 
four or more) bit streams, thereby producing corre- 
spondingly more potential levels of increasing quality re- 
produced source program signals. 
[0023] Specifically, the illustrative environment of Fig. 
2 adds additional source coder 13, additional delay 15, 
additional receive buffer 19, and additional decoder 23, 
to the components shown in Fig. 1 and described above. 
In particular, the program source, A(n), is encoded by 
each of source coders 11,12, and 1 3 to produce three 
independent bit streams, a n (n), a^n), and a 3 (n), respec- 
tively. As in the case of the illustrative environment 
shown in Fig. 1 , each of these source coders may com- 
prise any one of a number of conventional packet-based 
coders familiar to those of ordinary skill in the art, and 
as may be used for the coding of, for example, audio or 
video program data for transmission across a packet- 
based network such as, for example, the Internet. Fur- 
ther, source coders 11,12, and 1 3 may advantageously 
implement one of a number of various coding schemes, 
each of which is familiar to those of ordinary skill in the 
art, designed to provide characteristics analogous to 
those described above in connection with Fig. 1 . 
[0024] Specifically, signal a 2 (n), as generated by 
source coder 12, and signal a 3 (n), as generated by 
source coder 1 3, are each delayed prior to transmission 
(relative to the transmission of signal a^n) as generated 
by source coder 11 as well as relative to each other) by 
conventional delay elements 14 and 15, respectively. 
The amount of delay which is applied by delay element 
14, n d1 , is advantageously approximately equal to the 
difference in the delays incurred by the receive buffers 
used at the receiver for the decoding of the two data 
streams, a t (n) and a 2 (n), while the amount of delay 
which is applied by delay element 15, n^, is advanta- 
geously approximately equal to the difference in the de- 
lays incurred by the receive buffers used at the receiver 
for the decoding of the two data streams, a^n) and a 3 
(n). (Seethe discussion below.) Thus, delay element 14 
produces signal a 2 (n-n d1 ), namely, signal a 2 (n) delayed 
by an amount of time n d1 , while delay element 15 pro- 
duces signal a 3 (n-n d2 ), namely, signal a 3 (n) delayed by 
an amount of time n^. Note that advantageously, n d1 < 

n d2- 

[0025] In accordance with th illustrative embodiment 
of Fig. 2, the receiving end of channel 16 comprises 
three receive buffers -- receive buffers 17, 18, and 19. 



Receive buffer 1 7 is adapted to receiv the data stream 
which was transmitt d as a^n), rec iv buffer 18 is 
adapted to rec iv the data stream which was transmit- 
ted as a^n), and receiv buff r 1 9 is adapted to receive 

5 the data stream which was transmitt d as a 3 (n). Advan- 
tageously, receiv buffer 17 has an associated buff r 
delay of n 1t receive buffer 18 has an associated buffer 
delay of n 2 , and receive buffer 19 has an associated 
buffer delay of n 3 , specifically wherein ^ > n 2 > n 3 . In 

io particular, n 1 advantageously approximately equals the 
sum of n 2 and n d1 (/.e., n 1 = n 2 + n d1 ), where n d1 is the 
delay associated with delay element 14 described 
above. Similarly, n 1 advantageously approximately 
equals the sum of n 3 and n d2 (i.e., n 1 = n 3 + n^), where 

1$ n<g is the delay associated with delay element 15 de- 
scribed above. 

[0026] Receive buffers 17,19, and 1 9 are used to pro- 
vide the input to decoders 21 , 22, and 23, respectively. 
These three decoders correspond to source coders 11 , 

20 12, and 13, and are used to generate corresponding re- 
productions of the original source program from the 
three data streams a^n), a^n), and a 3 (n), denoted in 
the figure as b^n), b 2 (n), and b 3 (n), respectively. In par- 
ticular, decoders 21 , 22, and 23 implement conventional 

25 decoding of packet-based bit streams, and, in particular, 
use decoding algorithms which correspond to the en- 
coding algorithms that were used by source coders 11 , 
12, and 13. 

[0027] Finally, in accordance with the principles of the 

30 present invention as embodied in the illustrative envi- 
ronment of Fig. 2, selection processor 24 operates to 
produce the resulting reproduction of the original source 
program, B(n), by selecting the output of either decoder 
21, decoder 22, or decoder 23, according to the amount 

35 of time which has elapsed either since receiver start-up 
or since a receiver channel change has resulted in the 
selection of a different broadcast source program. Spe- 
cifically, in this case, the output of decoder 23 is initially 
selected (after delay n 3 has elapsed, thereby enabling 

40 the proper decoding of bit stream a 3 (n)). Once delay n 2 
has elapsed (thereby enabling the proper decoding of 
bit stream a^n)), the output of decoder 22 may be ad- 
vantageously selected instead. And finally, once delay 
n 1 has elapsed (thereby enabling the proper decoding 

^5 of bit stream a^n)), the output of decoder 21 may be 
advantageously selected to provide the highest quality 
reproduction of the original source program. (Recall that 
in accordance with the illustrative embodiment of the 
present invention being described herein, n 1 > n 2 > n 3 .) 

so in this manner, a hierarchical sequence of reproductions 
of the program source, each having somewhat better 
quality than the one provided before it, may be advan- 
tageously provided after a sufficient corresponding de- 
lay has elapsed. 

55 [0028] The preceding merely illustrates the principles 
of the invention. It will thus be appreciated that those 
skill d in the art will be able to devise various arrange- 
ments which, although not xplicitly described or shown 
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h rein, embody the principl s of the inv ntion and are 
inciud d within its scop as determin d by th append- 
ed claims. Thus, ail examples and conditional language 
recited herein ar principally intended expressly to be 
only for pedagogical purposes to aid the reader in un- 
d rstanding the principles of the invention and the con- 
cepts contributed by the inventors to furthering the art, 
and are to be construed as being without limitation to 
such specifically recited examples and conditions. 
Moreover, all statements herein reciting principles, as- 
pects , and embodiments of the invention , as well as spe- 
cific examples thereof, are intended to encompass both 
structural and functional equivalents thereof. Addition- 
ally, it is intended that such equivalents include both cur- 
rently known equivalents as well as equivalents devel- 
oped in the future, i.e., any elements developed that per- 
form the same function, regardless of structure. 
[0029] Thus, for example, it will be appreciated by 
those skilled in the art that the block diagrams herein 
represent conceptual views of illustrative circuitry em- 
bodying the principles of the invention. Similarly, it will 
be appreciated that any flow charts, flow diagrams, state 
transition diagrams, pseudocode, and the like represent 
various processes which may be substantially repre- 
sented in a computer readable medium and so executed 
by a computer or processor, whether or not such com- 
puter or processor is explicitly shown. 
[0030] The functions of the various elements shown 
in the figures, including functional blocks labeled as 
Aprocessors= may be provided through the use of ded- 
icated hardware as well as hardware capable of execut- 
ing software in association with appropriate software. 
When provided by a processor, the functions may be 
provided by a single dedicated processor, by a single 
shared processor, or by a plurality of individual proces- 
sors, some of which may be shared. Moreover, explicit 
use of the term Aprocessors or Acontrollers should not 
be construed to refer exclusively to hardware capable 
of executing software, and may implicitly include, with- 
out limitation, digital signal processor (DSP) hardware, 
read-only memory (ROM) for storing software, random 
access memory (RAM), and non -volatile storage. Other 
hardware, conventional and/or custom, may also be in- 
cluded. Similarly, any switches shown in the figures are 
conceptual only. Their function may be carried out 
through the operation of program logic, through dedicat- 
ed logic, through the interaction of program control and 
dedicated logic, or even manually, the particular tech- 
nique being selectable by the implementoras more spe- 
cifically understood from the context. 
[0031] In the claims hereof any element expressed as 
a means for performing a specified function is intended 
to encompass any way of performing that function in- 
cluding, for example, a) a combination of circuit ele- 
ments which performs that function, orb) software in any 
form, including, therefore, firmware, microcode or the 
like, combined with appropriate circuitry for xecuting 
that software to perform the function. The invention as 
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defined by such claims resides in the fact that the func- 
tionalities provided by the vari us recited means are 
combined and brought tog therinth manner which the 
claims call for. Applicant thus regards any means which 
5 can provide those functionalities as quivalent as those 
shown h r in. 

Claims 

10 

1 . A method of processing two or more sequences of 
data packets received from a network (1 6), each of 
said sequences of data packets representing a 
common program source, the method comprising 
*5 the steps of: 

buffering data packets comprised in a first one 
of said sequences in a first receive buffer (17) 
having a first buffering delay (n^; 
20 buffering data packets comprised in a second 

one of said sequences in a second receive buff- 
er (18) having a second buffering delay (n 2 ), 
wherein said second buffering delay is smaller 
than said first buffering delay; 
25 decoding (22) the data packets in said second 

receive buffer (18) after said second buffering 
delay (n 2 ) has elapsed; 
decoding (21) the data packets in said first re- 
ceive buffer (17) after said first buffering delay 
30 (n^ has elapsed; and 

generating (24) a reproduction of said program 
source based at least upon the decoding (22) 
of the data packets buffered in said second re- 
ceive buffer (18) after said second buffering de- 
35 lay (n 2 ) has elapsed, and based at least upon 

the decoding (21) of the data packets buffered 
in said first receive buffer (17) after said first 
buffering delay (n^ has elapsed. 

40 2. A method as claimed in claim 1 wherein said net- 
work (16) comprises the Internet. 

3. A method as claimed in claim 1 wherein the first se- 
quence of data packets and the second sequence 

45 of data packets have been transmitted onto the net- 
work (16) from a source location (11,12), the trans- 
mission of the second sequence of data packets 
having been delayed (14) relative to the transmis- 
sion of the first sequence of data packets by a given 
so relative transmission delay (n d ). 

4. A method as claimed in claim 3 wherein the given 
relative transmission delay (n d ) is approximately 
equal to the difference between the first buffering 

55 delay (n.,) and the s cond buffering delay (n 2 ). 

5. A method as claim d in claim 1 wherein the first re- 
ceive buffer (1 7) has a first buffer size and the sec- 
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ond receiv buffer (1 8) has a second buffer size, a 
mathematical ratio of the first buffer size to th sec- 
ond buff r size b ing approximately equai to a 
mathematical ratio of th first buffering d lay to the 
second buffering d lay. 

6. A method as claimed in claim 1 wherein the program 
source is encoded with a multiple descriptive 
source coder (11,12) which generates two or more 
individual bit streams, the second sequence of data 
packets comprising one of said individual bit 
streams and the first sequence of data packets 
comprising at least another one of said individual 
bit streams. 

7. A method as claimed in claim I wherein the program 
source is encoded with an embedded coder (11,12) 
which generates a core layer and one or more en- 
hancement layers, the second sequence of data 
packets comprising an encoding of said core layer 
and the first sequence of data packets comprising 
at least an encoding of one or more of said one or 
more enhancement layers. 

8. An apparatus for processing two or more sequenc- 
es of data packets received from a network (1 6), 
each of said sequences of data packets represent- 
ing a common program source, the apparatus com- 
prising: 

a first receive buffer (1 7) having a first buffering 
delay (n^ for buffering data packets comprised 
in a first one of said sequences; 
a second receive buffer (18) having a second 
buffering delay (n 2 ) for buffering data packets 
comprised in a second one of said sequences, 
wherein said second buffering delay is smaller 
than said first buffering delay; 
a decoder (22, 21) for decoding the data pack- 
ets buffered in said second receive buffer (1 8) 
after said second buffering delay (n 2 ) has 
elapsed and for decoding the data packets buff- 
ered in said first receive buffer (17) after said 
first buffering delay (n^ has elapsed; and 
a signal generator (24) for generating a repro- 
duction of said program source based at least 
upon the decoding of the data packets buffered 
in said second receive buffer after said second 
buffering delay (n 2 ) has elapsed, and based at 
least upon the decoding of the data packets 
buffered in said first receive buffer after said 
first buffering delay (n^ has elapsed. 

9. Apparatus as claimed in claim 8 wherein said net- 
work (1 6) comprises the Internet. 

10. Apparatus as claimed in claim 8 wher in th first 
sequence of data packets and the second se- 



quence of data packets hav be n transmitted onto 
then twork(16)fromasourc location (11, 12), the 
transmission of th second sequ nc ofdatapack- 
ts having been delay d (14) relativ to the trans- 
5 mission of the first s quence of data packets by a 
giv n relative transmission d lay (n d ). 

1 1 . Apparatus as claimed in claim 1 0 wherein the given 
relative transmission delay (n d ) is approximately 

« equal to the difference between the first buffering 
delay (n.,) and the second buffering delay (n 2 ). 

12. Apparatus as claimed in claim 8 wherein the first 
receive buffer ( 1 7) has a first buffer size and the sec- 

« ond receive buffer (1 8) has a second buffer size, a 
mathematical ratio of the first buffer size to the sec- 
ond buffer size being approximately equal to a 
mathematical ratio of the first buffering delay to the 
second buffering delay. 

20 

13. Apparatus as claimed in claim 8 wherein the pro- 
gram source is encoded with a multiple descriptive 
source coder (11,12) which generates two or more 
individual bit streams, the second sequence of data 

25 packets comprising one of said individual bit 
streams and the first sequence of data packets 
comprising at least another one of said individual 
bit streams. 

30 14. Apparatus as claimed in claim 8 wherein the pro- 
gram source is encoded with an embedded coder 
(11,12) which generates a core layer and one or 
more enhancement layers, the second sequence of 
data packets comprising an encoding of said core 
35 layer and the first sequence of data packets com- 
prising at least an encoding of one or more of said 
one or more enhancement layers. 



1. VerfahrenzurVerarbeitung von zweiodermehrSe- 
quenzen von aus einem Netz (16) empfangenen 
Datenpaketen, wobei jede der Sequenzen von Da- 
tenpaketen eine gemeinsame Programmquelle 
darstellt, mit den folgenden Schritten: 

Pufferspeichem von in einer ersten der Se- 
quenzen enthaltenen Datenpaketen in einem 
ersten Empfangspuffer(17), der eine erste Puf- 
ferspeicherungsverzogerung (n^ aufweist; 

Pufferspeichem von in einer zweiten der Se- 
quenzen enthaltenen Datenpaketen in einem 
zweiten Empfangspuffer (18), der eine zweite 
Pufferspeicherungsverzogerung (n 2 ) aufweist, 
wobei die zweite Pufferspeicherungsverzoge- 
rung kleiner als die erste Pufferspeicherungs- 
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v rzdg rungist; 

Decodier n (22) der Datenpakete in dem zwei- 
ten Empfangspuffer (18), nachd m di zweite 7. 
Pufferspeicherungsverzog rung (n 2 ) abg lau- s 
fen 1st; 

Decodieren (21) der Datenpakete in dem er- 
sten Empfangspuffer (17), nachdem die erste 
Pufferspeicherungsverzogerung (n^ abgeiau- 10 
fen ist; und 

Erzeugen (24) einer Reproduktion der Pro- 
grammqueile auf der Grundiage des Decodie- 8. 
rens (22) mindestens der in dem zweiten Emp- '5 
fangspuffer (18) gepufferten Datenpakete, 
nachdem die zweite Pufferspeicherungsverzd- 
gerung (n 2 ) abgelaufen ist, und auf der Grund- 
iage mindestens des Decodierens (21) der in 
dem ersten Empfangspuffer (17) gepufferten 20 
Datenpakete, nachdem die erste Pufferspei- 
cherungsverzogerung (n.,) abgelaufen ist. 

2. Verfahren nach Anspruch 1, wobei das Netz (16) 
das Internet umfaBt. 25 

3. Verfahren nach Anspruch 1 , wobei die erste Se- 
quenz von Datenpaketen und die zweite Sequenz 
von Datenpaketen von einem Quellenort (11, 12) 

auf das Netz (16) ubertragen worden sind, wobei 30 
die Ubertragung der zweiten Sequenz von Daten- 
paketen relativ zu der Ubertragung der ersten Se- 
quenz von Datenpaketen um eine gegebene relati- 
ve Ubertragungsverzogerung (n^ verzogert wurde 
(14). 35 

4. Verfahren nach Anspruch 3, wobei die gegebene 
relative Ubertragungsverzogerung (n d ) ungefahr 
gleich der Diff erenz zwischen der ersten Pufferspei- 
cherungsverzogerung (n,) und der zweiten Puffer- 40 
speicherungsverzogerung (r^) ist. 

5. Verfahren nach Anspruch 1 , wobei der erste Emp- 
fangspuffer (17) eine erste PuffergroBe aufweist 
und der zweite Empfangspuffer (18) eine zweite *s 
PuffergroBe aufweist, wobei ein mathematisches 
Verhaltnis der ersten PuffergroBe zu der zweiten 
PuffergroBe ungefahr gleich einem mathemati- 
schen Verhaltnis der ersten Pufferspeicherungsver- 
zogerung zu der zweiten Pufferspeicherungsverzo- so 
gerung ist. 

6. Verfahren nach Anspruch 1 , wobei die Programm- 9. 
quelle mit einem Mehrfach-Beschreibungs- 
Quellencodier r(11, 12) codiertwird, derzweioder 55 
mehr einzelne Bitstrome rzeugt, wobei die zweite 10. 
Sequenz von Datenpak ten einen der inzeln n 
Bitstrome und die erst S quenz von Datenpaketen 



mindestens einen weit rendereinz Inen Bitstrome 
umfaBt. 

Verfahr n nach Anspruch 1 , wob i die Programm- 
quell mit in meingeb ttet n Codierer (1 1 , 1 2) co- 
diertwird, der ein Kemschicht und in odermeh- 
rere Verbesserungsschichten erzeugt, wobei die 
zweite Sequenz von Datenpaketen eine Codierung 
der Kemschicht und die erste Sequenz von Daten- 
paketen mindestens eine Codierung einer oder 
mehrerer der einen oder mehreren Verbesserungs- 
schichten umfaBt. 

Vorrichtung zur Verarbeitung von zwei oder mehr 
Sequenzen von aus einem Netz (1 6) empfangenen 
Datenpaketen, wobei jede der Sequenzen von Da- 
tenpaketen eine gemeinsame Programmquelle 
darstellt, umfassend: 

einen ersten Empfangspuffer (17), der eine er- 
ste Pufferspeicherungsverzogerung (n^ auf- 
weist, zum Pufferspeichern von in einer ersten 
der Sequenzen enthaltenen Datenpaketen; 

einen zweiten Empfangspuffer (18), der eine 
zweite Pufferspeicherungsverzogerung (n 2 ) 
aufweist, zum Pufferspeichern von in einer 
zweiten der Sequenzen enthaltenen Datenpa- 
keten, wobei die zweite Pufferspeicherungs- 
verzogerung kleiner als die erste Pufferspei- 
cherungsverzogerung ist; 

einen Decodierer (22, 21) zum Decodieren der 
in dem zweiten Empfangspuffer (18) gepuffer- 
ten Datenpakete, nachdem die zweite Puffer- 
speicherungsverzogerung (n 2 ) abgelaufen ist, 
und zum Decodieren der in dem ersten Emp- 
fangspuffer (17) gepufferten Datenpakete, 
nachdem die erste Pufferspeicherungsverzo- 
gerung (n t ) abgelaufen ist; und 

einen Signalgenerator (24) zum Erzeugen ei- 
ner Reproduktion der Programmquelle auf der 
Grundiage mindestens des Decodierens der in 
dem zweiten Empfangspuffer gepufferten Da- 
tenpakete, nachdem die zweite Pufferspeiche- 
rungsverzogerung (n 2 ) abgelaufen ist, und auf 
der Grundiage mindestens des Decodierens 
der in dem ersten Empfangspuffer gepufferten 
Datenpakete, nachdem die erste Pufferspei- 
cherungsverzogerung (n^ abgelaufen ist. 

Vorrichtung nach Anspruch 8, wobei das Netz (16) 
das Internet umfaBt. 

Vorrichtung nach Anspruch 8, wobei die erste Se- 
quenz von Datenpaketen und die zweite Sequenz 
von Datenpaketen von einem Quellenort (11, 12) 
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auf das Netz (16) ubertragen worden sind, wobei 
di Ub rtragung der zweit n S quenz von Daten- 
paket n r lativ zu der Ubertragung der rsten S - 
qu nz von Dat npak ten urn eine gegebene relati- 
ve Ub rtragungsverzdg rungfn^v rzogertwurde 5 
(14). 

1 1 . Vorrichtung nach Anspruch 1 0, wobei die gegebene 
relative Ubertragungsverzogerung (n d ) ungefahr 
gleich der Differenz zwischen der ersten Pufferspei- io 
cherungsverzogerung (n^ und derzweiten Puffer- 
speicherungsverzogerung (n 2 ) ist. 

12. Vorrichtung nach Anspruch 8, wobei dererste Emp- 
fangspuffer (17) eine erste PuffergroGe aufweist is 
und der zweite Empfangspuffer (1 8) eine zweite 
PuffergroGe aufweist, wobei ein mathematisches 
Verhaltnis der ersten PuffergroGe zu der zweiten 
PuffergroGe ungefahr gleich einem mathemati- 
schen Verhaltnis der ersten Pufferspeicherungsver- 20 
zogerung zu derzweiten Pufferspeicherungsverzo- 
gerung ist. 

13. Vorrichtung nach Anspruch 8, wobei die Programm- 
quelle mit einem Mehrfach-Beschreibungs- 2s 
Quellencodierer (11,12) codiert wird, der zwei oder 
mehr einzelne Bitstrome erzeugt, wobei die zweite 
Sequenz von Datenpaketen einen der einzelnen 2. 
Bitstrome und die erste Sequenz von Datenpaketen 
mindestens einen weiteren der einzelnen Bitstrome 30 
umfaGt. 3. 

14. Vorrichtung nach Anspruch 8, wobei die Programm- 
quelle mit einem eingebetteten Codierer (11,12) co- 
diert wird, der eine Kernschicht und eine oder men- 35 
rere Verbesserungsschichten erzeugt, wobei die 
zweite Sequenz von Datenpaketen eine Codierung 
der Kernschicht und die erste Sequenz von Daten- 
paketen mindestens eine Codierung einer oder 
mehrerer der einen oder mehreren Verbesserungs- *o 
schichten umfaGt. 4. 



Revendications 

45 

1. Procede de traitement de deux ou plusieurs se- 
quences de paquets de donn6es recues depuis un 5. 
reseau (16), chacune desdites sequences de pa- 
quets de donnees representant une source de pro- 
gramme commune, le proc6de comprenant les eta- so 
pes de : 

mise en memoire tampon de paquets de don- 
nees compris dans une premiere desdites se- 
quences dans un premier tampon de reception ss 
(17) ayant un premier r tard de mise en me- 
moire tampon (n«,) ; 

mise en memoire tampon de paquets de don- 6. 



ne s compris dans une deuxieme desdites se- 
quences dans un deuxieme tampon de recep- 
tion (18) ayant un deuxieme retard de mise en 
m6moire tampon (n 2 ), dans lequel ledit deuxie- 
m retard d mise nm'moir tampon est in- 
ferieur audit pr mier retard de mise n memoire 
tampon ; 

decodage (22) des paquets de donnees dans 
ledit deuxieme tampon de reception (18) apres 
I'arrivee a terme dudit deuxieme retard de mise 
en memoire tampon (n 2 ) ; 
decodage (21) des paquets de donnees dans 
ledit premier tampon de reception (17) apres 
I'arrivee a terme dudit premier retard de mise 
en memoire tampon (n^ ; et 
generation (24) d'une reproduction de iadite 
source de programme bas6e au moins sur le 
decodage (22) des paquets de donnees mis en 
memoire tampon dans ledit deuxieme tampon 
de reception (1 8) apres I'arrivee a terme dudit 
deuxieme retard de mise en m6moire tampon 
(n 2 ), et basee au moins sur le decodage (21) 
des paquets de donn6es mis en memoire tam- 
pon dans ledit premier tampon de reception 
(1 7) apres I'arrivee a terme dudit premier retard 
de mise en memoire tampon (n^. 

Procede selon la revendication 1 , dans lequel ledit 
reseau (16) comprend Nnternet. 

Procede selon la revendication 1, dans lequel la 
premiere sequence de paquets de donnees et la 
deuxieme sequence de paquets de donnees ont ete 
transmises sur le reseau (16) a partir d'un empla- 
cement source (11, 12), la transmission de la 
deuxieme sequence de paquets de donnees ayant 
ete retardee (14) par rapport a la transmission de 
la premiere sequence de paquets de donnees par 
un retard de transmission relatif donne (n d ). 

Procede selon ia revendication 3, dans lequel le re- 
tard de transmission relatif donne (n d ) est approxi- 
mativement egal a la difference entre le premier re- 
tard de mise en memoire tampon (n.,) et le deuxife- 
me retard de mise en memoire tampon (n 2 ). 

Procede selon la revendication 1 , dans lequel le 
premier tampon de reception (17) a une premiere 
capacite de tampon et le deuxieme tampon de re- 
ception (18) a une deuxieme capacite de tampon, 
un rapport math6matique de la premiere capacite 
de tampon sur la deuxieme capacite de tampon 
etant approximativement egal a un rapport mathe- 
matique du premier retard de mise en memoire tam- 
pon sur le deuxieme retard de mise en memoire 
tampon. 

Procede selon la revendication 1 , dans lequel la 
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source de programm s est code avec un codeur 
source descriptif multiple (11, 12) qui genere deux 
ouplusi urs trains binair s individuels, la deuxieme 
s6qu nee de paquets d donne s comprenant un 
desdits trains binaires individuels t ia premiere se- 5 
qu nee de paqu ts d donnees comprenant au 
moins un autre desdits trains binaires individuels. 

Precede selon la revendication 1 , dans lequel le 
programme source est code avec un codeur inttgre 1 o 
(11,12) qui gen&re une couche de base et une ou 
plusieurs couches de rehaussement, la deuxieme 
sequence de paquets de donnees comprenant un 
codage de ladite couche de base et la premiere se- 
quence de paquets de donnees comprenant au 1$ 
moins un codage d'une ou de plusieurs desdites 
une ou plusieurs couches de rehaussement. 

Dispositif pour traiter deux ou plusieurs sequences 
de paquets de donnees recues depuis un r6seau 20 
(16), chacune desdites sequences de paquets de 
donnees reprgsentant une source de programme 
commune, le dispositif comprenant: 

un premier tampon de reception (17) ayant un 25 
premier retard demise en memoire tampon (n t ) 
pour mettre en memoire tampon des paquets 
de donnees compris dans une premiere desdi- 
tes sequences ; 

un deuxieme tampon de reception (18) ayant 30 
un deuxieme retard de mise en memoire tam- 
pon (n 2 ) pour mettre en m6moire tampon des 
paquets de donnees compris dans une deuxie- 
me desdites sequences, dans lequel ledit 
deuxieme retard de mise en memoire tampon 35 
est inferieur audit premier retard de mise en 
memoire tampon ; 

un d6codeur (22, 21 ) pour decoder les paquets 
de donnees mis en memoire tampon dans ledit 
deuxieme tampon de reception (1 8) apres Tar- 40 
rivee k terme dudit deuxieme retard de mise en 
memoire tampon (n 2 ) et pour decoder les pa- 
quets de donnees mis en memoire tampon 
dans ledit premier tampon de reception (17) 
apres Tarrivee k terme dudit premier retard de 45 
mise en memoire tampon (n.,) ; et 
un gen6rateur de signaux (24) pour gen6rer 
une reproduction de ladite source de program- 
me en se basant au moins sur le decodage des 
paquets de donnees mis en memoire tampon so 
dans ledit deuxieme tampon de reception apres 
I'arrivee & terme dudit deuxieme retard de mise 
en memoire tampon (n 2 ), et en se basant au 
moins sur le decodage des paquets de don- 
nees mis en memoire tampon dans ledit pre- 55 
mier tampon de reception apres I'arrivee k ter- 
me dudit premier retard de mise en memoire 
tampon (n^. 



9. Dispositif s Ion la revendication 8, dans lequel ledit 
r6seau (16) compr nd Pint met. 

10. Dispositif selon la revendication 8, dans lequel la 
premiere sequence d paquets d donnees et la 
deuxieme sequence d paquets de donnees ont ete 
transmises sur le reseau (16) k partir d'un empla- 
cement source (11, 12), la transmission de la 
deuxieme sequence de paquets de donnees ayant 
ete retardee (14) par rapport k la transmission de 
la premiere sequence de paquets de donnees par 
un retard de transmission relatif donne (n d ). 

11. Dispositif selon la revendication 10, dans iequel le 
retard de transmission relatif donne (n d ) est ap- 
proximativement egal k la difference entre le pre- 
mier retard de mise en memoire tampon (n.,) et le 
deuxieme retard de mise en memoire tampon (n 2 ). 

12. Dispositif seion la revendication 8, dans lequel le 
premier tampon de reception (17) a une premiere 
capacite de tampon et le deuxieme tampon de re- 
ception (18) a une deuxieme capacite de tampon, 
un rapport mathematique de la premiere capacite 
de tampon sur la deuxieme capacite de tampon 
etant approximativement egal k un rapport mathe- 
matique du premier retard de mise en memoire tam- 
pon sur le deuxieme retard de mise en memoire 
tampon. 

13. Dispositif selon la revendication 8, dans lequel la 
source de programme est codee avec un codeur 
source descriptif multiple (11,12) qui genere deux 
ou plusieurs trains binaires individuels, la deuxieme 
sequence de paquets de donnees comprenant un 
desdits trains binaires individuels et la premiere se- 
quence de paquets de donnees comprenant au 
moins un autre desdits trains binaires individuels. 

14. Proc6d6 selon ia revendication 8, dans lequel le 
programme source est code avec un codeur integre 
(11,12) qui genere une couche de base et une ou 
plusieurs couches de rehaussement, la deuxieme 
sequence de paquets de donnees comprenant un 
codage de ladite couche de base et la premiere se- 
quence de paquets de donnees comprenant au 
moins un codage d'une ou plusieurs desdites une 
ou plusieurs couches de rehaussement. 
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